Remote control systems that can distinguish stray light sources

ABSTRACT

Remote control systems that can distinguish predetermined light sources from stray light sources, e.g., environmental light sources and/or reflections are provided. The predetermined light sources can be disposed in asymmetric substantially linear or two-dimensional patterns. The predetermined light sources also can output waveforms modulated in accordance with one or more signature modulation characteristics. The predetermined light sources also can output light at different signature wavelengths.

FIELD OF THE INVENTION

The present invention can relate to remote control systems that candistinguish predetermined light sources from stray light sources.

BACKGROUND OF THE INVENTION

Some remote control systems use infrared (IR) emitters to determine theposition and/or movement of a remote control. For example, if IRemitters are mounted proximate to a television, the remote control maybe able to detect its own motion by measuring the motion of the IRemitters with respect to the remote control.

Such systems, however, often experience a common problem in that theymay not be able to distinguish desired or predetermined IR light sourcesfrom undesirable environmental IR sources, e.g., the sun or a lightbulb. Because those systems may mistake environmental IR sources for IRemitters, they may incorrectly determine the position and/or movement ofthe remote control.

Such systems also may experience another common problem in that thesystems may not be able to distinguish IR emitters from reflections ofthe IR emitters, e.g., from the surface of a table or a window. Forexample, when IR emitters are disposed in a pattern that is symmetricalabout a horizontal axis, the remote control system may mistakereflections of the IR emitters from a table surface for the actual IRemitters. Or, when IR emitters are disposed in a pattern that issymmetrical about a vertical axis, the remote control system may mistakereflections of the IR emitters from a window for the actual IR emitters.Again, such mistakes may result in incorrect determinations of theposition and/or movement of the remote control.

SUMMARY OF THE INVENTION

The present invention can include remote control systems that candistinguish predetermined light sources from stray or unintended lightsources, such as environmental light sources and/or reflections.

In one embodiment of the present invention, the predetermined lightsources can be disposed in asymmetric substantially linear ortwo-dimensional patterns. Here, a photodetector can detect light outputby the predetermined light sources and stray light sources, and transmitdata representative of the detected light to one or more controllers.The controllers can identify a derivative pattern of light sources fromthe detected light indicative of the asymmetric pattern in which thepredetermined light sources are disposed.

In another embodiment of the present invention, the predetermined lightsources can output waveforms modulated in accordance with signaturemodulation characteristics. By identifying light sources that exhibitthe signature modulation characteristics, a controller of the presentinvention can distinguish the predetermined light sources from straylight sources that do not modulate their output in accordance with thesignature modulation characteristics.

In a further embodiment of the present invention, each predeterminedlight source can output light at one or more different signaturewavelengths. For example, a photodetector module of the presentinvention can detect the signature wavelengths using multiplephotodetectors, each of which can detect one of the signaturewavelengths. Alternatively, the photodetector module can include aninterleaved photodetector having an array of interleaved pixels.Different portions of the interleaved pixels can detect one of thesignature wavelengths.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other advantages of the present invention will be apparentupon consideration of the following detailed description, taken inconjunction with accompanying drawings, in which like referencecharacters refer to like parts throughout, and in which:

FIG. 1 illustrates one embodiment of a remote control system of thepresent invention having an asymmetric pattern of predetermined lightsources;

FIG. 2 illustrates a process for distinguishing predetermined lightsources from stray light sources based on the pattern in which the lightsources are disposed in accordance with one embodiment of the presentinvention;

FIGS. 3A-3E illustrate additional embodiments of asymmetric patterns ofpredetermined light sources in accordance with the present invention;

FIG. 4 illustrates a remote control system of one embodiment of thepresent invention that can distinguish predetermined light sources fromstray light sources based on signature modulation characteristics withwhich output waveforms of the predetermined light sources are modulated;

FIG. 5 illustrates a process of one embodiment of the present inventionfor distinguishing predetermined light sources from stray light sourcesbased on signature modulation characteristics with which outputwaveforms of the predetermined light sources are modulated; and

FIGS. 6A-6B illustrate interleaved photodetectors in accordance with oneembodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

The present invention can include remote control systems that candistinguish predetermined light sources from stray light sources, suchas environmental light sources and/or reflections.

FIG. 1 illustrates one embodiment of a remote control system of thepresent invention. Remote control system 10 can include remote control12 and multiple predetermined light sources 16. Predetermined lightsources 16 can be disposed in frame 18 to form light transmitter 14 orintegrated with display 20. As used herein, light sources can eithergenerate light or reflect light shined thereon. If light source(s) actas reflector(s), another light source can project light towards thereflector(s). The reflector(s) can reflect the light back to aphotodetector. For example, the photodetector and the other light sourcecan be disposed on remote control 12, whereas the reflector(s) can bedisposed proximate to, near, on, or in display 20.

Remote control system 10 can permit a user to interact with an imageshown on display 20 by manipulating remote control 12. Display 20 canproject an image substantially defined by orthogonal x- and y-axes.Display 20 can include a television having a screen with a nominalcurvature, a computer monitor having a screen with a nominal curvature,a flat-screen television, a flat-screen monitor, a surface upon which aprojector can project images, or any other type of display known in theart or otherwise.

Remote control system 10 can permit a user to move or otherwise selectobject 19 (e.g., a cursor) shown on display 20 in the x- and y-axes bypointing remote control 12 at desired locations on or proximate todisplay 20. Ray R can indicate the location at which remote control 12is pointing. Remote control system 10 can detect the remote control'smotion by measuring the motion of predetermined light sources 16 withrespect to its own. Based on the detected motion, remote control system10 can determine the absolute x- and y-positions of the location towhich the remote control is pointing with respect to one or morereference locations, e.g., one or more of the predetermined lightsources. Remote control system 10 then can be used to move object 19 tothe determined location. Thus, when the user moves remote control 12 inthe x- and y-axes, display 20 can show a corresponding movement inobject 19 in the x- and y-axes.

Predetermined light sources 16 can emit, e.g., infrared (1R) light 22 toremote control 12. Remote control 12 can detect the emitted light usingphotodetector 24. Photodetector 26 can include CCD arrays, CMOS arrays,two-dimensional position sensitive photodiode arrays, other types ofphotodiode arrays, other types of light detection devices known in theart or otherwise, or a combination thereof.

In accordance with the present invention, predetermined light sources 16can be spatially constrained in an asymmetric substantially linearpattern in frame 18. The substantially linear pattern can be parallel toa longitudinal axis of transmitter 14 and asymmetric about an axisorthogonal to the longitudinal axis of transmitter 14. For example, asshown in FIG. 1, remote control system 10 can include threepredetermined light sources 16 disposed in a substantially linearpattern. The distance between left-most predetermined light source 16 aand middle predetermined light source 16 b can be less than that betweenmiddle predetermined light source 16 b and right-most predeterminedlight source 16 c. While FIG. 1 illustrates three predetermined lightsources, remote control system 10 can include four or more predeterminedlight sources disposed in an asymmetric substantially linear pattern.

Predetermined light sources 16 can be disposed proximate any edge ofdisplay 20, e.g., a top, bottom, or vertical edge of display 20 eitherin frame 18 or integrated with display 20. Predetermined light sources16 also can be disposed substantially co-planar with the screen of thedisplay. Alternatively, transmitter 14 and/or predetermined lightsources 16 can be disposed at another location near, on, or beneathdisplay 20.

Remote control system 10 also can include controller 26, which can bedisposed in remote control 12. Controller 26 can accept datarepresentative of light detected by photodetector 24. In a mannerdescribed in greater detail below with respect to FIG. 2, controller 26can distinguish predetermined light sources from stray light sourcesusing the photodetector data. The controllers described herein caninclude processors, memory, ASICs, circuits and/or other electroniccomponents.

Remote control 12 also can incorporate user input component 28. A usermay actuate user input component 28 when the user wants remote controlsystem 10 to perform an action. For example, a user my actuate userinput component 28 when the user is moving remote control 12 and wantsobject 19 to reflect similar motion on display 20. When the user is notactuating user input component 28, remote control system 10 can beconfigured to take no action.

User input component 28 can be a scrollwheel similar to thatincorporated by a portable media player sold under the trademark iPod™by Apple Computer, Inc. of Cupertino, Calif. The scrollwheel can includeone or more buttons and a touchpad or other input device. The touchpadcan permit a user to scroll through software menus by running the user'sfinger around the track of the scrollwheel. User input component 38 alsocan include, for example, one or more buttons, a touchpad, a touchscreendisplay, or a combination thereof.

Remote control system 10 also can include optional console 30. Console30 can have controller 32 that can perform some or all of the processingdescribed for controller 26. For example, remote control 12 can transmitdata representing detected IR light 22 to console 30. Controller 32 inconsole 30 then can identify predetermined light sources 16 from thelight sources detected by photodetector 24.

In one embodiment of the present invention, console 30 can communicatewith remote control 12 using cable 34 and/or one or more wirelesscommunication protocols known in the art or otherwise. Console 30 alsocan communicate with transmitter 14 using cable 35 and/or one or morewireless communication protocols known in the art or otherwise. Console30 also can communicate with display 20 using cable 36 and/or one ormore wireless communication protocols known in the art or otherwise.Alternatively, console 30 can be integrated with display 20 as one unit.

Console 40 also can have one or more connectors 43 to which accessoriescan be coupled. Accessories can include cables 44 and/or 46, gamecartridges, portable memory devices (e.g., memory cards, external harddrives, etc.), adapters for interfacing with another electronic device(e.g., computers, camcorders, cameras, media players, etc.), orcombinations thereof.

FIG. 2 illustrates one embodiment of a process that controller 26 or 32can employ to distinguish predetermined light sources from stray lightsources based on the pattern in which the predetermined light sourcesare disposed. In step 40, controller 26 or 32 can accept datarepresentative of light detected by photodetector 24. In step 42,controller 26 or 32 can identify a plurality of (e.g., all) points ofinterest (POIs) or detected light sources from the photodetector data,regardless of whether the light source is one of predetermined lightsources 16 or a stray light source. Identification of a POI can includedetermining positional characteristics of the detected light source. Asused herein, the “positional characteristics” of a light source or groupof light sources can include characteristics that indicate the absoluteor relative position and/or geometry of the light source(s), e.g., theabsolute x- and y-positions of the light source(s).

To determine the absolute x- and y-positions of the light sourcesdetected by photodetector 24, controller 26 or 32 can use any availabletechniques known in the art. For example, U.S. Pat. No. 6,184,863 toSibert et al., issued on Feb. 6, 2001, and No. 7,053,932 to Lin et al,issued on May 30, 2006, the entireties of which are incorporated hereinby reference, describe two techniques that can be employed by controller26 or 32. U.S. Patent Application Publication No. 2004/0207597 to Marks,published on Oct. 21, 2004; No. 2006/0152489 to Sweetser et al.,published on Jul. 13, 2006; No. 2006/0152488 to Salsman et al.,published on Jul. 13, 2006; and No. 2006/0152487 to Grunnet-Jepsen etal., published on Jul. 13, 2006, the entireties of which also areincorporated herein by reference, describe additional techniques thatcan be employed by controller 26 or 32. Remote control system 10 alsocan employ other techniques known in the art or otherwise.

In step 44, controller 26 or 32 can identify a plurality of (e.g., allpossible) permutations of the light sources identified in step 42. Eachpermutation can contain the same number of light sources as the numberof predetermined light sources. In the illustrative embodiment of FIG.1, controller 26 or 32 can identify a plurality of (e.g., all possible)triads, which can be sets of three POIs identified in step 42. In step46, controller 26 or 32 can correlate the pattern formed by eachpermutation or triad identified in step 44 to the asymmetric pattern inwhich predetermined light sources 16 are disposed. Correlationtechniques can include statistical techniques, e.g., Chi-square test,least-squares test, or another correlation technique known in the art orotherwise. Controller 26 or 32 can quantify the correlation bydetermining a correlation coefficient for each permutation or triad.Each correlation coefficient can indicate how well the pattern formed byeach permutation matches the pattern formed by the predetermined lightsources.

When a user is manipulating remote control 12, the remote control maynot be aligned with predetermined light sources 16 in such a way thatany of the permutations or triads identified in step 44 will have apattern that perfectly matches the asymmetric pattern in whichpredetermined light sources 16 are disposed. Accordingly, in correlatingthe pattern formed by each permutation or triad identified in step 44 tothe asymmetric pattern of predetermined light sources 16, controller 26or 32 can account for perceived translation, roll, and/or scaling of theasymmetric pattern in the x- and/or y-axes. As used herein, roll of apattern of predetermined light sources may refer to the rotation of thepattern about an axis orthogonal to the x- and y-axes. Scaling of apattern of predetermined light sources may refer to the enlargement orreduction of the pattern in the x- and/or y-axes.

In step 48, controller 26 or 32 can identify a predetermined number of Npermutations or triads that form patterns that approximate theasymmetric pattern in which predetermined light sources 16 are disposed.Assuming that the correlation coefficients determined in step 46increase the closer the pattern formed by a permutation correlates tothe pattern in which predetermined light sources 16 are disposed,controller 26 or 32 can identify permutations having the bestcorrelation by identifying permutations having the highest correlationcoefficients. However, if the correlation coefficients determined instep 46 decrease the closer the pattern formed by a permutationcorrelates to the pattern in which predetermined light sources 16 aredisposed, controller 26 or 32 can identify permutations having the bestcorrelation by identifying permutations having the lowest correlationcoefficients.

In step 50, controller 26 or 32 can compare the positionalcharacteristics of each permutation or triad identified in step 48 with“good” values determined in previous solutions. Positionalcharacteristics compared in step 50 may include, e.g., the x-position ofeach POI, y-position of each POI, perceived translation of the patternformed by predetermined light sources 16, perceived roll of the patternformed by predetermined light sources 16, and/or perceived scaling ofthe pattern formed by predetermined light sources 16. Based on thecomparison performed in step 50, controller 26 or 32 can identify the“winning” permutation or triad that most likely corresponds topredetermined light sources 16 in step 52.

In one embodiment of the present invention, controller 26 or 32 canidentify in step 48 the permutation having the best correlation (i.e.,N=1). In this case, steps 50 and/or 52 may be unnecessary.

As discussed above, remote control 12 may not be aligned withpredetermined light sources 16 in such a way that the pattern of the“winning” permutation will perfectly match the asymmetric pattern inwhich predetermined light sources 16 are disposed. Instead, the patternof the “winning” permutation may be a derivative indicative of theasymmetric pattern in which predetermined light sources 16 are disposed.For example, the derivative pattern of the “winning” permutation may betranslated, rotated, and/or scaled with respect to the asymmetricpattern in which predetermined light sources 16 are disposed.

In one embodiment of the present invention, controller 26 or 32 cancontinuously reiterate steps 40-52 for each frame of data collected byphotodetector 24. However, there may not be a need to distinguishpredetermined light sources 16 from stray light sources with each frameof data collected by photodetector 24. In the latter case, controller 26or 32 can be configured to only perform steps 40-52 for every Jth frameof data collected by photodetector 24, wherein J is a predeterminednumber. For example, after controller 26 or 32 performs step 44, thecontroller can be configured to determine whether photodetector 24 hascollected J frames of data (step 54). If photodetector 24 has collectedJ frames of data, controller 26 or 32 then can perform step 46 asdescribed above. However, if photodetector 24 has not collected J framesof data yet, controller 26 or 32 can jump to step 50. That is,controller 26 or 32 can compare positional characteristics of eachpermutation or triad identified in step 44 with “good” values determinedin previous solutions. Based on the comparison performed in step 50,controller 26 or 32 can identify the “winning” permutation that mostlikely corresponds to predetermined light sources 16 in step 52.

FIGS. 3A-3C illustrate alternative asymmetric patterns in which todispose predetermined light sources in accordance with the presentinvention. Similar to the embodiment of FIG. 1, predetermined lightsources 62 of FIGS. 3A-3C also can be disposed in frame 64 to formtransmitter 60 or integrated with display 20. In the embodiments ofFIGS. 3A-3C, however, predetermined light sources 62 can be spatiallyconstrained in a two-dimensional pattern that is asymmetric aboutlongitudinal axis L and/or an axis orthogonal thereto.

For example, as shown in FIG. 3A, predetermined light sources 62 can bedisposed in a two-dimensional pattern that is asymmetric aboutlongitudinal axis L. This configuration may be useful to assist remotecontrol system 10 in distinguishing predetermined light sources 62 fromreflections of the predetermined light sources from a surface disposedparallel to longitudinal axis L, e.g., a table surface.

As shown in FIG. 3B, predetermined light sources 62 can be disposed in atwo-dimensional pattern that is asymmetric about an axis orthogonal tolongitudinal axis L. This configuration may be useful to assist remotecontrol system 10 in distinguishing predetermined light sources 62 fromreflections of the predetermined light sources from a surface disposedparallel to an axis orthogonal to longitudinal axis L, e.g., a window.

As shown in FIG. 3C, predetermined light sources 62 can be disposed in atwo-dimensional pattern that is asymmetric about both longitudinal axisL and an axis orthogonal thereto.

FIGS. 3D-3E illustrate alternative asymmetric patterns in whichpredetermined light sources can be spatially constrained in accordancewith the present invention. Predetermined light sources 72 can bedisposed on frames 74 a-74 d, which in turn can be disposed proximate tothe edges of display 20, e.g., top, bottom, and/or vertical edges.Alternatively, predetermined light sources 72 can be integrated intodisplay 20 proximate to the edges of display 20. Advantageously, whenpredetermined light sources are disposed proximate to top and bottomedges of display 20, remote control system 10 can detect a greater rangeof vertical motion.

When disposed proximate to display, predetermined light sources 72 canform a two-dimensional pattern that can be asymmetric about an axisparallel and/or orthogonal to the direction of gravity. This is not tosay that each group of predetermined light sources 72 disposed proximateto each edge of display 20 needs to form a two-dimensional patternand/or be asymmetric about an axis parallel and/or orthogonal to thedirection of gravity. For example, in FIG. 3D, predetermined lightsources 72 a can form a symmetric two-dimensional pattern andpredetermined light sources 72 b can form an asymmetric one-dimensionalpattern. In FIG. 3E, predetermined light sources 72 c and predeterminedlight sources 72 d each can form an asymmetric substantially linearpattern. Indeed, the pattern formed by predetermined light sources 72 dcan be the same pattern formed by predetermined light sources 72 c, butrotated 180 degrees. Advantageously, each of the illustrative patternsformed by the predetermined light sources in FIGS. 3D and 3E may beuseful in assisting remote control system 10 to distinguish thepredetermined light sources from reflections of the predetermined lightsources from surfaces disposed both parallel and orthogonal to thedirection of gravity.

Asymmetric arrangements of predetermined light sources, whether insubstantially linear or two-dimensional patterns, also can permit remotecontrol system 10 to determine whether remote control 12 is upside-downor not. For example, if a remote control system employs a symmetricalpattern of IR emitters, the controller may not be able to distinguishwhether a user is holding the remote control with, e.g., user inputcomponent 28 pointing in the positive y-direction or in the negativey-direction. By disposing predetermined light sources 16 in anasymmetric pattern, a controller of the present invention candistinguish between these configurations by comparing the locations ofthe detected predetermined light sources relative to each other.

In accordance with another aspect of the present invention, remotecontrol systems can modulate output waveform(s) of one or morepredetermined light sources in accordance with one or more predeterminedor signature modulation characteristics. For example, genres ofsignature modulation characteristics can include, e.g., frequency, dutycycle, phase shift, another pulse train signature, or a combinationthereof. For example, the remote control system can continuously turntwo predetermined light sources ON and OFF at first and secondpredetermined frequencies or otherwise adjust the signal strengths ofthe two predetermined light source output waveforms at the predeterminedfrequencies. The first and second frequencies can have the same value ordifferent values. The remote control system can distinguishpredetermined light sources that output modulated waveforms from straylight sources by identifying light sources that exhibit the signaturemodulation characteristics.

FIG. 4 illustrates one embodiment of remote control system 80 of thepresent invention that can distinguish predetermined light sources fromstray light sources by identifying light sources that exhibit, e.g., thesignature frequencies at which predetermined light source waveforms maybe modulated. Transmitter 81 can include first and second predeterminedlight sources 82 a and 82 b and one or more frames 84 on which thepredetermined light sources are disposed. Modulator(s) 85 canfrequency-modulate output of predetermined light sources 82 a and 82 bso that the predetermined light sources are turned ON and OFF atfrequencies f1 and f2 (respectively). Alternatively, modulator(s) 85 canfrequency-modulate the output of the predetermined light sources so thatthe signal strengths of the outputs are otherwise adjusted in apredetermined manner at frequencies f1 and f2. In one embodiment of thepresent invention, light output from predetermined light sources 82 aand 82 b can be modulated at predetermined frequencies that may be lesslikely to be encountered in a user's environment, e.g., between 100 KHzand 300 KHz, inclusive.

Remote control 86 can include photodetector 88 and controller 90. In oneembodiment of the present invention, photodetector 88 can be atwo-dimensional position sensitive diode (PSD). In the embodiment ofFIG. 4, frequencies f1 and f2 can have different values that are greaterthan the frame rate at which photodetector 88 captures data.

Controller 90 can include first and second frequency demodulators 92 aand 92 b, each of which can demodulate the photodetector data inaccordance with one of the signature frequencies at which predeterminedlight sources 82 a and 82 b may be modulated. Demodulator 92 a canaccept output from photodetector 88 and extract the x- and y-positionsof predetermined light source 82 a with respect to remote control 86.Likewise, demodulator 92 b can accept output from photodetector 88 andextract the x- and y-positions of predetermined light source 82 b withrespect to remote control 86. In alternative embodiments of the presentinvention, controller 90 can be disposed in a console, e.g., console 30of FIG. 1, or within display 20.

While FIG. 4 illustrates transmitter 81 with two predetermined lightsources, one of the predetermined light sources can be eliminated oradditional predetermined light sources can be added. In the latter case,the predetermined light sources can be disposed in an asymmetric orsymmetric pattern. Furthermore, the signature frequency or frequenciesat which the predetermined light sources can be modulated can be slowerthan the frame rate at which a photodetector collects data. In oneembodiment of the present invention, one or more predetermined lightsources can be modulated at a signature frequency on the order of 10 Hz.

In alternative embodiments of the present invention, modulator(s) 85 canmodulate output waveforms of predetermined light sources 82 a and 82 bin accordance with another genre or combinations of genres of signaturemodulation characteristic(s). Demodulators 92 a and 92 b then can beconfigured to demodulate output data from photodetector 88 with respectto those genres of signature modulation characteristic(s). In furtheralternative embodiments of the present invention, the demodulators ofFIG. 4 may be replaced with correction filters.

FIG. 5 illustrates one embodiment of a process that a remote controlsystem of the present invention can employ to distinguish predeterminedlight sources from stray light sources by identifying light sources thatexhibit, e.g., the signature frequencies at which output waveforms ofthe predetermined light sources are modulated. In step 100, thecontroller can accept data representative of light detected by aphotodetector disposed, e.g., in a remote control. In step 102, thecontroller can identify a plurality of (e.g., all) points of interest(POIs) or detected light sources from the photodetector data, regardlessof whether the light source is one of the predetermined light sources ora stray light source. Identification of a POI may include determiningpositional characteristics of each detected light source.

In step 104, the controller can track each POI identified in step 102for a predetermined number of M frames. Thereafter, in step 106, thecontroller can determine a modulation characteristic, e.g., thefrequency, at which the light detected for each POI is modulated overthose M frames. For stray light sources that may not modulate orinfrequently modulates its light output over the M frames, e.g., thesun, the determined frequency may be very low, e.g., approximately zero.

In step 108, the controller can correlate the modulationcharacteristics, e.g., the frequencies, determined in step 106 to thesignature modulation characteristic(s) at which the predetermined lightsources are modulated. The controller can quantify the correlation bydetermining a correlation coefficient for each POI. The correlationcoefficient may indicate how well the modulation characteristicdetermined for each POI in step 106 matches the signature modulationcharacteristic(s) at which waveforms output by the predetermined lightsources are modulated.

In step 110, the controller can identify a predetermined number K ofPOIs having modulation characteristics that approximate the signaturemodulation characteristic(s) at which waveforms output by thepredetermined light sources are modulated. Assuming that the correlationcoefficients determined in step 110 increase the closer a modulationcharacteristic determined in step 106 correlates to one of the signaturemodulation characteristics, the controller can identify POIs having thebest correlation by identifying the POIs having the highest correlationcoefficients. However, if the correlation coefficients determined instep 108 decrease the closer a modulation characteristic determined instep 106 correlates to one of the signature modulation characteristics,the controller can identify POIs having the best correlation byidentifying the POIs having the lowest correlation coefficients.

In step 112, the controller can compare the positional characteristicsof each POI identified in step 110 with “good” values determined inprevious solutions. Based on the comparison performed in step 112, thecontroller can identify the “winning” POIs that most likely correspondto the predetermined light sources in step 114.

In one embodiment of the present invention, the controller cancontinuously reiterate steps 100-114 for each frame of data collected bythe photodetector. However, there may not be a need to distinguish thepredetermined light sources from stray light sources with each frame ofdata collected by the photodetector. In the latter case, the controllercan be configured to only perform steps 100-114 for every Lth frame ofdata collected by the photodetector, wherein L is a predeterminednumber. For example, after the controller performs step 102, thecontroller can be configured to determine whether the photodetector hascollected L frames of data (step 116). If the photodetector hascollected L frames of data, the controller then can perform step 104 asdescribed above. However, if the photodetector has not collected Lframes of data yet, the controller can jump to step 112. That is, thecontroller can compare the positional characteristics of each POIidentified in step 102 with “good” values determined in previoussolutions. Based on the comparison performed in step 112, the controllercan identify the “winning” POIs that most likely correspond topredetermined light sources in step 114.

In addition to or instead of modulating the outputs of predeterminedlight sources at signature frequencies, the remote control system of thepresent invention also can modulate output waveform(s) of one or morepredetermined light sources at signature or predetermined duty cycle(s).Output waveforms can be modulated at different or the same predeterminedduty cycle(s). The remote control system also can incorporate one ormore phase shifts between waveforms output by multiple predeterminedlight sources.

In one embodiment of the present invention, a remote control system canhave two or more predetermined light sources, the output waveforms ofwhich can be modulated in accordance with different signature modulationcharacteristics having different predetermined values or genres.Advantageously, this may permit the remote control system to determinewhether remote control is upside-down. For example, if a remote controlsystem employs a symmetrical pattern of IR emitters, the controller maynot be able to distinguish whether a user is holding the remote controlwith, e.g., a user input component pointing in the positive y-directionor in the negative y-direction. By modulating the predetermined lightsource outputs in accordance with different signature modulationcharacteristics, a controller of the present invention can distinguishbetween these configurations.

In accordance with another aspect of the present invention,predetermined light sources can output light at different signaturewavelengths, e.g., in the IR spectrum. For example, a remote controlsystem of the present invention can include first and secondpredetermined light sources. The first predetermined light source canemit light at first wavelength λ1 and the second predetermined lightsource can emit light at second wavelength λ2. A photodetector module,e.g., disposed in a remote control, can include first and secondphotodetectors. The first photodetector can be configured to detectlight having first wavelength λ1 and the second photodetector can beconfigured to detect light having second wavelength λ2. Alternatively,the photodetector module can be an interleaved photodetector.Advantageously, a remote control system having predetermined lightsources that output light of different wavelengths can permit the remotecontrol system to determine whether a remote control is upside-down.

FIGS. 6A-6B illustrate embodiments of interleaved photodetectors inaccordance with the present invention. Interleaved photodetector 120 canbe a single unit having an array of interleaved pixels 122.Predetermined pixels 122 a of the array can be configured to detectlight having first wavelength λ1 whereas other predetermined pixels 122b of the array can be configured to detect light having secondwavelength λ2. For example, alternating rows of pixels (see FIG. 6A) oralternating columns of pixels can be configured to detect light havingdifferent wavelengths λ1 and λ2. Alternatively, as shown in FIG. 6B, acheckerboard of pixels can be configured to detect light havingdifferent wavelengths λ1 and λ2. In the embodiments of FIGS. 6A-6B,pixels indicated with hatching may be configured to detect light havingfirst wavelength λ1 and pixels indicated without hatching may beconfigured to detect light having second wavelength λ2.

In accordance with another aspect of the present invention, a remotecontrol system of the present invention can combine two or more of theembodiments described above. For example, a remote control system of thepresent invention can have multiple predetermined light sources disposedin an asymmetric pattern. The output waveform of one of thepredetermined light sources can be modulated in accordance with one ormore signature modulation characteristics. The remote control system ofthe present invention can be configured to distinguish the predeterminedlight sources from stray light sources using a two step process. First,the remote control system can identify a light source that exhibits thesignature modulation characteristic. Second, the remote control systemcan identify a derivative pattern of light sources that include thelight source identified in the first step and that is indicative of theasymmetric pattern in which the predetermined light sources aredisposed.

Although particular embodiments of the present invention have beendescribed above in detail, it will be understood that this descriptionis merely for purposes of illustration. Alternative embodiments of thosedescribed hereinabove also are within the scope of the presentinvention. For example, predetermined light sources can be disposed in aremote control and a photodetector can be disposed in a display, in aframe disposed proximate to the display, or at any location proximateto, on, or near a display.

A remote control of the present invention can be any electronic devicein a system that may need to distinguish predetermined light sourcesfrom stray light sources. For example, the remote control can be anyportable, mobile, hand-held, or miniature consumer electronic device.Illustrative electronic devices can include, but are not limited to,music players, video players, still image players, game players, othermedia players, music recorders, video recorders, cameras, other mediarecorders, radios, medical equipment, calculators, cellular phones,other wireless communication devices, personal digital assistances,programmable remote controls, pagers, laptop computers, printers, orcombinations thereof. Miniature electronic devices may have a formfactor that is smaller than that of hand-held devices. Illustrativeminiature electronic devices can include, but are not limited to,watches, rings, necklaces, belts, accessories for belts, headsets,accessories for shoes, virtual reality devices, other wearableelectronics, accessories for sporting equipment, accessories for fitnessequipment, key chains, or combinations thereof.

While the above description may have described certain components asbeing physically separate from other components, one or more of thecomponents can be integrated into one unit. For example, thephotodetector or photodetector module can be integrated with one or morecontrollers.

Also, a controller in the display can perform some or all of theprocessing described above for controllers 26 and/or 32. Thus, multiplecontrollers may be used to control remote control systems of the presentinvention.

Furthermore, while the illustrative remote control systems describedabove may have included predetermined light sources that output lightwaves, one or more of the predetermined light sources can be replacedwith component(s) that output or reflect other types of energy waveseither alone or in conjunction with light waves. For example, thecomponent(s) can output radio waves.

The above described embodiments of the present invention are presentedfor purposes of illustration and not of limitation, and the presentinvention is limited only by the claims which follow.

1. A system comprising: a first plurality of predetermined light sourcesdisposed in an asymmetric substantially linear pattern; a photodetectorconfigured to detect light sources and generate photodetector datarepresentative of the detected light sources; and a controllerconfigured to: determine positional characteristics of the detectedlight sources from the photodetector data; and identify a derivativepattern of light sources using the positional characteristics, whereinthe derivative pattern is indicative of the asymmetric substantiallylinear pattern.
 2. The system of claim 1, wherein the first plurality ofpredetermined light sources comprises one or more predetermined lightsources that generate light.
 3. The system of claim 1, wherein the firstplurality of predetermined light sources comprises one or morepredetermined light sources that reflect light.
 4. The system of claim1, wherein the first plurality of predetermined light sources isdisposed in a display.
 5. The system of claim 1, further comprising aremote control within which the photodetector is disposed.
 6. The systemof claim 1, wherein the controller is disposed in a display.
 7. Thesystem of claim 1, further comprising a console within which thecontroller is disposed.
 8. The system of claim 1, wherein the system iscoupled to a display having first and second edges, the system furthercomprising a second plurality of predetermined light sources, whereinthe first plurality of predetermined light sources is disposed proximatethe first edge of the display and the second plurality of predeterminedlight sources is disposed proximate the second edge of the display. 9.The system of claim 8, wherein the first edge of the display is a topedge of the display and the second edge of the display is a bottom edgeof the display.
 10. The system of claim 8, wherein the first and secondpluralities of predetermined light sources form a two-dimensionalpattern that is asymmetric about at least one of first and secondorthogonal axes.
 11. The system of claim 1, wherein the detected lightsources comprises the first plurality of predetermined light sources andstray light sources, and wherein the controller is further configuredto: identify a plurality of permutations of the detected light sources,wherein each permutation comprises the same number of detected lightsources as the first plurality of predetermined light sources, whereinthe detected light sources of each permutation form a detected pattern;determine a correlation coefficient for each permutation, wherein eachcorrelation coefficient indicates how well a detected pattern matchesthe asymmetric substantially linear pattern; and use the correlationcoefficients to identify one or more of permutations having detectedpatterns that approximate the asymmetric substantially linear pattern.12. The system of claim 1, wherein the derivative pattern is at leastone of translated, rotated, and scaled with respect to the asymmetricsubstantially linear pattern.
 13. The system of claim 1, wherein thecontroller is configured to: determine the position of the photodetectorwith respect to the plurality of predetermined light sources using thederivative pattern.
 14. A system coupled to a display having first andsecond edges, the system comprising: a first plurality of predeterminedlight sources disposed proximate the first edge of the display; a secondplurality of predetermined light sources disposed proximate the secondedge of the display, wherein the first and second pluralities ofpredetermined light sources form a two-dimensional pattern that isasymmetric about first and second orthogonal axes; a photodetectorconfigured to detect light sources and generate photodetector datarepresentative of the detected light sources; and a controllerconfigured to identify a derivative pattern of light sources from thephotodetector data, wherein the derivative pattern is indicative of thetwo-dimensional pattern.
 15. The system of claim 14, wherein the firstedge of the display is a top edge of the display and the second edge ofthe display is a bottom edge of the display.
 16. The system of claim 14,wherein the controller is further configured to: determine positionalcharacteristics of the detected light sources from the photodetectordata; and identify the derivative pattern using the positionalcharacteristics.
 17. The system of claim 14, wherein the derivativepattern is at least one of translated, rotated, and scaled with respectto the two-dimensional pattern.
 18. The system of claim 14, wherein thecontroller is configured to: determine the position of the photodetectorwith respect to the first plurality and the second plurality ofpredetermined light sources using the derivative pattern.
 19. A methodfor distinguishing a first predetermined number of predetermined lightsources from stray light sources, wherein the predetermined lightsources are disposed in a target pattern, the method comprising: (a)accepting photodetector data from a photodetector, wherein thephotodetector data is indicative of light detected by the photodetector;(b) identifying a plurality of detected light sources from thephotodetector data; (c) identifying a plurality of permutations of thedetected light sources, wherein each permutation comprises the samenumber of detected light sources as the first predetermined number ofpredetermined light sources, and wherein the detected light sources ofeach permutation form a detected pattern; (d) determining a correlationcoefficient for each permutation, wherein each correlation coefficientindicates how well a detected pattern matches the target pattern; and(e) using the correlation coefficients to identify one or morepermutations having detected patterns that approximate the targetpattern.
 20. The method of claim 19, further comprising comparingpositional characteristics of each of the one or more permutationsidentified in (e) with a previous solution.
 21. The method of claim 19,further comprising: repeating steps (a)-(c); and comparing eachpermutation identified in (c) with a previous solution.
 22. The methodof claim 19, wherein determining a correlation coefficient for eachpermutation comprises accounting for translation, roll, and scaling ofthe target pattern.
 23. The method of claim 19, further comprising:determining the position of the photodetector with respect to thepredetermined light sources using one of the identified one or morepermutations.